Optimal weighting in /nl constraints from large scale structure in an idealised case 
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We consider the problem of optimal weighting of tracers of structure for the purpose of constraining 
the non-Gaussianity parameter /nl ■ We work within the Fisher matrix formalism expanded around 
fiducial model with /nl = and make several simplifying assumptions. By slicing a general sample 
into infinitely many samples with different biases, we derive the analytic expression for the relevant 
Fisher matrix element. We next consider weighting schemes that construct two effective samples 
from a single sample of tracers with a continuously varying bias. We show that a particularly 
simple ansatz for weighting functions can recover all information about /nl in the initial sample 
that is recoverable using a given bias observable and that simple division into two equal samples is 
considerably suboptimal when sampling of modes is good, but only marginally suboptimal in the 
limit where Poisson errors dominate. 

PACS numbers: 98.80.Jk, 98.80.Cq 
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I. INTRODUCTION 

The currently most attractive theory for the emergence 
of structure in the Universe is inflation [J 0, H, 4] ■ It is 
generically successful at diluting the primordial defects to 
undetectable densities and predicts a nearly-flat universe 
with nearly scale invariant spectrum of primordial fluctu- 
ations that are normally distributed and extend to scales 
larger than horizon [H,[g, 0, @, 9]. To understand details 
of the inflation, on must look at detailed predictions of 
different models. Non-Gaussianity of the primordial cur- 
vature perturbations, i.e small departures from the nor- 
mal distribution of fluctuations is one aspect in which 
models of inflation differ. 

Recently, non-Gaussianity of the local /nl type has re- 
ceived a renewed attention. This type of non-Gaussianity 
is characterised by a quadratic correction to the potential 
IE IE IE 111 : ' 
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where is the primordial potential assumed to be a Gaus- 
sian random field and /nl describes the amplitude of the 
correction during the matter domination era. There are 
two main reasons for this renewed interest. First, there 
is a hint of a detection in the cosmic microwave data 
[E] and several non-detections [E [E IE]- Second, a 
new method for its detection has been recently proposed 
in [E] • This method uses biased tracers of structure for 
which it can be shown that local-type of non-Gaussianity 
leads to a very particular scale-dependence of the bias 



A& = fsh(b - l)u(fc), 



(2) 



where A6 is the bias induced by non-Gaussianity, b is the 
tracer's intrinsic bias and u is given by 



u{k) 
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where T(k) is the matter transfer function normalised 
to unity at k = 0, D(z) is the growth function nor- 
malised to (1 + z)^ 1 in the matter era, S c — 1.68 is the 
linear over-density at collapse for the spherical collapse 
model and other symbols have their usual meaning. Note 
that Ab becomes significant only at large scales, where 
non-linearities and scale-dependent bias are expected to 
be small and therefore offers a surprisingly clean probe 
of non-Gaussianity. This equation has been re-derived, 
scrutinised and better understood in the subsequent work 

[E m m n. 

A first application of this method to the real data us- 
ing a wide variety of tracers of large scale has recently 
shown the promise of this method |20j, l2l| . The derived 
constraints are already competitive with those coming 
from the cosmic microwave background. In that work, 
the constraints were derived by comparing the power 
spectrum of the distribution of tracers with those pre- 
dicted by the theory. At largest scales, where the ef- 
fect coming from the non-Gaussianity is the largest, the 
method suffers from the sample variance. In other words, 
the finite number of large-scale modes in any survey 
severely limits our ability to measure the power spec- 
trum. Recently, Seljak has suggested a method of cir- 
cumventing this limitation [231 ] . This method essentially 
considers two differently biased tracers that sample the 
same volume. The ratio of amplitudes of a single mode 
for the two tracers will give the ratio of the two biases 
(&i + A6i(/ NL ))/(>2 + A6 2 (/nl)), but the amplitude of 
the primordial mode cancels out. One thus measures the 
auto correlation power spectra of the two tracers in the 
same volume. By taking the ratio of these two spectra, 
one can put a constraint on the value of /nl, which is 
independent on the primordial field and thus unaffected 
by the sample variance. The biases b\ and 62 can be 
derived from the amplitude of small scale fluctuations, 
where sampling variance is not a problem and hence, one 
extremely well measured large-scale mode is in principle 
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enough to constrain /nl ■ A more robust technique would 
be to assume nothing about the matter power spectrum 
and derive limits on /nl from limits on the scale depen- 
dence of ratio of b + Ab. This would protect measure- 
ments of /nl from systematics arising from, for example, 
massive neutrinos. 

In practice, one rarely has two distinct samples with a 
well-defined bias. In this work, we extended the analy- 
sis by considering a single tracer of the underlying field 
that spans a range of biases and attempt to answer the 
question of how to optimally analyse such tracer. The 
approach we take is to create two effective samples and 
to optimally weight the tracer's constituents. 

II. APPROACH AND LIMITATIONS OF THIS 
WORK 

In this paper we assume that the Equations (J2J) and ([3|) 
are exactly correct. These equations have initially been 
derived using Press-Schecter [24j and related formalisms. 
They have now been tested for dark matter halos against 
TV-body simulations in two publications [25|, [26[ with 
somewhat differing conclusions. This is an issue that 
will have to be settled before further measurements of 
/nl are possible. 

If luminous objects are used for constraining the /nl 
parameter, they must sample the underlying population 
of halos randomly in the sense that they must insensitive 
to any property of the halo that might be correlated with 
the large-scale modes that induce the /nl dependence. 
While this is true for most objects, it is not necessarily 
true for quasars as discussed in [27|, where the Equation 
(J2J> was generalised to Ab = /nl(& — p)u(k), with p = 1 
for random halos and p ~ 1.6 for a population that is 
hosted by the recently merged halos. This is, of course, a 
rather crude approximation, but it illustrates a possible 
violation of the Equations ((21) and (|3|) . 

If this assumption holds then the stochasticity of each 
tracer will be zero on scales much larger than the typ- 
ical halo size. Stochasticity is a measure of how well a 
given tracer of large scale structure samples the under- 
lying dark matter field in the Gaussian cosmologies. In 
this work we consider a single tracer whose constituents 
have a range of biases and zero stochasticity. In partic- 
ular, each galaxy (or quasar or some other tracer) has 
an associated bias b, so that a subset of galaxies whose 
biases lie between b and b + Ab is a perfect tracer of the 
underlying dark matter field with a constant bias b. In 
other words, in Fourier space on scales of interest, 

S g (k) = M(k), (4) 

where S g is the over-density of galaxies and S is the 
over-density of matter at some wave-vector k. This 
assumption can be checked by considering the quan- 
tity P\2{k) I \J ' P\\{k)P22{k) , where P 12 is the cross- 
correlation power spectrum for the two samples and 
P11/P22 are the corresponding auto-correlation power 



spectra. Recent cross-correlation studies using counts in 
cells have shown that on large scales (> 10 Mpc/h) the 
stochasticity is indeed very small [28[. It is not funda- 
mental limit, but it means that improvement in signal 
to noise will stop beyond n = (P(l — r 2 )) -1 [231 ] . where 
r is the cross-correlation coefficient. It is also possible 
the clever schemes around this limitation might be con- 
structed [11]. 

Moreover, we assume that the noise associated with 
the sparse sampling of the underlying field can be de- 
scribed by a Poisson statistics. While this sounds a very 
reasonable approximation, recent work on TV-body sim- 
ulations indicate that the actual shot noise pro per ties 
might significantly deviate from Poisson statistics [36fl. 

Next we assume that there exist an observable that 
can be thought of as a proxy for the individual galaxy's 
bias. In practice, this can be the galaxy's luminosity, 
but in this paper we often operate with host halo bias 
mass that allows us to connect our calculations with the 
standard mass functions of the halo model. Since the 
bias is an ill-defined quantity on a single object, it suffices 
that an ensemble of galaxies with luminosity between L 
and L + AL has a mean bias b(L). If L is a "noisy" 
estimator for the galaxy's bias then the range of biases 
obtainable from various slicing of the original sample will 
be limited and hence any weighting based on L will be 
suboptimal. In the limiting case when L is a completely 
random variable, any slicing would produce two samples 
of the same bias and therefore it is impossible to put 
limits on /nl using method of [23j | . Our work derives 
the optimal weighting within the possibilities offered by 
a given measurable quantity and not optimal weighting 
in an absolute sense. 

The purposed of this paper is to derive the optimal 
weighting subject to limitations described above. How- 
ever, it must be stressed that if these conditions are not 
satisfied, the weighting will be suboptimal, but it would 
not lead to biased results. This is equivalent to the in- 
verse covariance weighting used in optimal quadratic esti- 
mators (see e.g. [3(|). If wrong power spectrum is used to 
create the covariance matrix, or if no inverse covariance 
weighting is performed at all, the results are suboptimal 
and the error-bars are larger then necessary, but results 
are not biased. Situation here is similar: the method 
that we present here is trivial to implement on real data, 
while the truly optimal weighting would require massive 
numerical work. We therefore deem it a useful step to- 
wards decreasing the error-bars on /nl constraints in fu- 
ture observational work. 

The paper is organised as follows. In Section IIII1 we 
consider slicing the sample into infinitely thin subsam- 
ples of varying bias and derive an analytic expression for 
the maximum signal-to-noise that can be obtained us- 
ing a Fisher matrix analysis. In the subsequent Section 
IIVI we consider how the sample can be weighted using 
two weighting functions to get two effective samples. We 
construct a weighting method whose Fisher matrix ele- 
ment for /nl is the same as those of the optimal analysis 
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and is thus itself optimal. We show that simple meth- 
ods of dividing the sample into two can be considerably 
ineffective. Section [V] briefly compares our results with 
optimal weights used in power spectrum determination. 
Final thoughts can be found in the Conclusions. 



III. INFORMATION CONTENT IN A TRACER 

Consider a tracer of mass that is composed of many 
individual objects that have different biases with respect 
to the underlying density field. For simplicity, let us 
assume that the variable that determines an individ- 
ual object's bias is its host halo mass, but note that 
in general it can be any continuous variable that varies 
monotonically with bias. The population is then char- 
acterised by b(M), the average bias of the objects with 
mass M and the mass function dn/dAf, which is the 
number density of objects with mass between M and 
M + dM. Let slice the total number of objects into 
N samples of different average bias. Each slice is cen- 
tred around mass Mi = Mmin + (i — 1/2) AM, where 
AM = (M max - M min )/N and has bias h = &(M 4 ) with 
number density of m = dn/dM(Mj)AM. Following [23| . 
we consider one Fourier mode of the underlying density 
field. Its covariance matrix has the form 



Cij =< SiSj >= —(bi + (bi -p)uf NL ) 



5 K 

1. 1 



x(b J + (b J -p)uf NL )P+^-. (5) 

Hi v 

Our ability to constrain /nl is determined by the 
Fisher matrix, whose /nl elements are 

^/nl /nl = ^Tr [C /NL C-!C /NL C-!] , (6) 

evaluated at our fiducial model, which has /nl = 0. In 
that limit we have 



1 ( 5 K N 
C ij = V (f + b i b j P 



(7) 



(C,/nl/ 



by 



; ; I I'll •: 2h,b, \,h, /,/,,: (8) 
In Appendix [X] we show that the inverse of C is given 



bibiP 



(9) 



v l + nP(b 2 )J' 

where we have replaced sums with the integrals and de 
fined averages to be over the mass function: 



-AW d „ 

n = I — dM 



M min 

1 f M — dn 



dM 



(10) 



n iM mm dM 



dn 



(b 2 ) = -r / ^-b 2 (M)dM 
n ^M mln dM 



(12) 



After some cumbersome, but straight-forward algebra, 
we arrive at 



F fN u„ = (uPnf (Co + C 1X + C 2 x 2 ) 



where 



and 



Pn 



1 + Pn (b 2 ) 



(13) 



(14) 



Co = 2 (P) 2 4 (6 2 ) (b)p+ (b) 2 p 2 + (6 2 )p 2 (15) 
C 1 = -A{b 2 ) 3 + 8(b 2 ) 2 (b)p-{b 2 ) 2 p 2 

-3(b 2 )(b) 2 p 2 (16) 

C 2 = 2 (6 2 ) 4 - 4 (b 2 ) 3 (b)p + 2 (b 2 ) 2 {bfp 2 (17) 

This result encodes that maximum information that can 
be extracted from a sample of objects. 

To get a better intuition about this formula, we define 



<a& 2 ) = (b 2 ) (by 



(18) 



In the Figure [T] we plot the functional shape for a couple 
of values of (6), (A£> 2 ) and Pn. 

This figure deserves some discussion. As expected in 
the limit of (b 2 ) = 0, the signal to noise drops to zero at 
(b) = p and monotonically increases with bias. In gen- 
eral, however, this is not the case. When we are in the 
Poisson limit and sampling is sparse, then it is still bet- 
ter to go with objects with the highest bias. In the other 
limit, when sampling of the modes is very good, it is 
better to have a bigger relative spread in the bias rather 
than bias that is high in average. This is slightly counter- 
intuitive, but remember that we assume here that each 
object has a known bias. But most importantly, when 
nP ~ 1 the overall best signal to noise is roughly inde- 
pendent of the mean bias, as long as we cover a sizeable 
range of biases. 

This analysis corresponds to a single mode. For any 
realistic survey, one needs to integrate across observed 
modes. The final error on /nl is given by 



JNL 



V 
2^2 



F. 



fe min=7 r/yi/3 



/nl/n 



fc 2 d/c, 



(19) 



where V is the volume of the survey and the pre-factors 
come from the volume of a single mode in the fc-space 
which equals ir 3 /V. 

The result of the Equation (|13|) is the maximum in- 
formation that is in principle available for extraction. In 
practice, it is not clear, how to extract this information 
- it would require a very fine slicing by the bias with 
cross-correlation of each slice with every other slice. In 
the next section we attempt a different approach - we 
divide the sample into two different samples and adjusts 
the weighting of the objects in the two samples so that 
the signal is maximised. 
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IV. OPTIMAL WEIGHTING 
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Following the previous section, we will consider weights 
that are function of the halo mass M. In practice, we 
do not know the host halo mass for individual objects, 
but one can equivalently use any proxy for bias, such as 
luminosity. 

Let us therefore consider two weighting functions a(M) 
and (3(M). Any given object in the a sample counts as 
a(M) objects. For example, when calculating the over- 
density in a cell, we weight the objects by ot(M): 



V ccll N a 



(20) 
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FIG. 1: This figure shows scaling of -F/ NL / NL with (6), (Ai> 2 ) 
and nP. Panels from the top to bottom correspond to val- 
ues of nP of 10" 2 , 1 and 10 2 , where n is the tracer's number 
density and P the underlying power spectrum. In each panel, 
thin solid lines correspond to values of (Ab 2 ) = 0, 1, 2, 4 (bot- 
tom up) and p = 1. Solid dashed lines are for (A6 2 ) = 0,4 
and p — 1.6. 



where index i runs over the halos in a given cell of volume 
V^oii and the mean weighted object density is given by 

N a = ja(M)^dn (21) 

and the same for the (3 sample. 

Using properties of the Poisson statistics, the effective 
bias and corresponding Poisson error are given by 

(iL=^/" (M, ^ dM (23) 

and an equivalent expression for the (3 sample. An impor- 
tant subtlety is, that if the weighting functions overlap, 
the cross term also acquires a Poisson error, given by 



(—) = ttV / <M)P{M)^-b{M)dM, (24) 
\n e s J a/3 N a N fj J dM 

For a two-sample case, the final error on the /nl can 
therefore be calculated by combining Equations (with 
new Poisson errors in the cross term), ([6]) and (fl9|) . Note 
that results are independent of any multiplicative con- 
stant on a or (3. However, one cannot assume that we 
are in the Poisson limit and therefore the matrix inver- 
sions have to be done without approximations. However, 
since we are discussing 2x2 matrices, this is not impos- 
sible. 

Consider next the following form for weighting func- 
tions a and (3: 



a = c a + b(M) 
l3 = c fj - b(M) 



(25) 
(26) 
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In this case, the relevant variables simplify to: 

N a = n{c a + (b}) (27) 
Np=n(cp-{b)) (28) 
c a (b) + (b 2 ) 



(b e s) a 
(b cS ) 



c a + (6) 
cp (b)-(b 2 ) 



cp - (b) 
1 (b 2 ) + 2 (b) c a + c\ 
n (c Q + (6)) 2 
1 (b 2 ) - 2 (6) cp + cj 
n ( C/J - (6)) 2 
1_\ _ 1 (-(b 2 ) + (b) (^-c a ) + c a cg) 



1 

"off, 

1 

n B sy pp 



(c a + (b))(cp-(b)) 



(29) 
(30) 
(31) 
(32) 
(33) 



We can now combine Equations (|2"7| - (j3"3"|) with Equa- 
tions ([5]) and © to obtain expression for -F/ NL / NL - This 
is a very cumbersome process that is best done with the 
help of a mathematical computer package. The final re- 
sult, however reduces to the exactly the same expression 
as that of Equation (fT3")) . This is a very interesting re- 
sult. It shows that any weighting that has the form of 
Equations ([23]) - (j!?6"|) produces optimal sensitivity to the 
/nl- 

In order to avoid dealing with nearly singular matrices, 
it is in practice advantageous to have weighting functions 
that have as little overlap as possible. We therefore pro- 
pose the following form the weighting functions: 



a(M) 
f3(M) = 



b(M) 



b{M) 



(34) 
(35) 



where & m i n and 6 m ax are the minimum and the maxi- 
mum value of bias in the range of interest. These optimal 
weighting functions are the main result of this paper. 

How does this compare to other weighting functions? 
The simplest case would be to divide the sample into two 
disjoint samples with no overlap: 



a(M) = H(M - M h ) 
(3(M) = 1 - a(M), 



(36) 
(37) 



where H(x) is the Heaviside step function and the barrier 
mass Mi, is a free parameter. This is essentially equiva- 
lent to the analysis of [23[ , where presumably an absolute 
magnitude cut is proposed to create two samples of a dif- 
ferent bias. 

We choose two possible values for Mb- First we con- 
sider M b such that the integral J dn/dM b(M)dM is the 
same for both samples. Second we use the Mi, that is 
such as to minimise the overall uj NL . 

In Figure [2] we plot how close the error on /nl ap- 
proaches the theoretically minimal error obtained by op- 
timal weighting. To plot this figure, we have assumed a 
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FIG. 2: This figure shows the relative performance of the 
weighting methods that divide samples into two compared 
to optimal weighting for a model survey discussed in Section 
Mil Top set of lines are for q — b(M), while bottom are for 
the numerically determined optimal choice of Mb. Different 
line-styles represent density of objects to that of the halos: 1 
(solid), 0.1 dashed and 0.01 (dotted). 



fiducial flat ACDM cosmology with matter density Q m = 
0.25, spectral index of primordial fluctuations of 0.96 and 
normalisation in 8 Mpc/h spheres of <rg — 0.85. More- 
over, we assumed a survey centred at redshift z = 0.5 
with volume V = l(Gpc/ft.) 3 and tracers with p = 1 
and used the mass function from the Sheth-Tormen the- 
ory and bias from an extended Press-Schecter formal- 
ism [3l], [IH- The upper limit of integration was set to 
0.05 Mpc/h. 

The x-axis of the plot is the minimal mass used for 
calculation of (b) and (b 2 ). The upper set of lines cor- 
responds to a naive ansatz of making J dn/dM b(M)dM 
equal for both subsamples, while the bottom set of lines 
for the best possible division that can be obtained using 
two disjoint samples with no weighing. The dashed and 
dotted lines show the dependence on the number-density 
of objects. Note, that changing the number density af- 
fects both optimal as well as suboptimal weighting and 
that we plot just the ratio of the two error-bars, rather 
than the size of the error-bars themselves. 

We see that the closer one is to the limit of well- 
sampled modes the more important it is to use weighting, 
but that weighting does not make any difference in the 
Poisson-limited sampling. For the particular survey pa- 
rameter that we chose, we note that for Mi, set by equal 
/ dn/dM b(M)dM for both samples, the weighting func- 
tion can be suboptimal to up to a factor of ~ 2 in the 
limit of small M m ; n , but that even the numerically opti- 
mised Mb can be significantly suboptimal. 

The above results have to be take with a pinch of salt, 
since we have used bias dependence on mass b(M) and 
the corresponding mass function dn/dM rather than bias 
dependence on luminosity b(L) and the luminosity func- 
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tion dn/dL. The latter is more closely related to the 
observations. Due to the scatter in luminosity - bias re- 
lation, the range of biases available by weighting by b(L) 
is smaller and this will affect the results. 



V. COMPARISON WITH POWER SPECTRUM 
WEIGHTING. 

Interestingly, the equations present in this paper are 
very close to those that can be found in [33|. In that 
work, authors find the optimal weighting for power spec- 
trum determination for a continuously biased tracer by 
generalising Feldman, Kaiser & Peacock [34| approach. 
In fact, the equations are very similar. Following exactly 
the same procedure as in Section IIII[ but for the power 
spectrum rather than /nl, one gets that in the limit of 
infinitely thin slicing 

( nib 2 ) V 

Fpp = (tt^F) j ■ (38) 

By using the weighing function a(M) = 6(M)[37j], which 
is the optimal weighting function found in [331 ] in our no- 
tation, we can show that a single sample weighted with 
a(M) (i.e, the one-dimensional covariance matrix) again 
recovers the full information Fpp. We therefore indepen- 
dently confirm the results of [Hj]. 

It is important to note that in this work, we have op- 
timised for a maximal F/ NL / NL rather than a minimal 
(F _1 )/ NL / NL . In other words, we calculate the weighting 
that maximises our ability to constrain /nl, assuming 
that other parameters, such as P are fixed and are pre- 
sumably constrained from other probes, such as cosmic 
microwave background. 

VI. CONCLUSIONS 

In this paper we have analysed the problem of op- 
timal weighting of biased tracers of structure with the 
goal of extracting maximum information about the non- 
Gaussianity parameter /nl- We have derived the mini- 
mum error on /nl by considering slices that are infinitely 
thin in bias. We have shown that a simple weighting 
scheme of Equations (p?5[) and (]2T)]) obtains the same con- 
straining power. General division of the full sample into 
two subsamples can be considerably sub-optimal even 
when mass at which the samples are divided is carefully 
chosen. 

The optimal weighting scheme of Equations (|25|) and 
(]2T)]) is surprisingly simple. In fact, the product Pn does 
not come into weighting at all - this is a lucky coincidence, 
which allows us to use the same optimal weighting for 
every mode, rather to optimize weighting around some 
fiducial wave- vector. 

The result in this paper is subject to the assumptions 
outlined in the Section [TT] of this paper. If these assump- 



tions are violated, the weighing is sub-optimal, but prob- 
ably nevertheless beneficiary. Since any division into two 
samples by e.g. an absolute magnitude cut requires some 
knowledge of bias, the implementation of the scheme pro- 
posed in this paper is likely to be very simple. 

How can this be put in practice? In this work we have 
used halo mass M as a proxy for the bias. However, our 
analysis is completely general and one can replace the 
host halo mass with any variable that is monotonically 
linked to the bias. For example, one could take luminous 
red galaxies (LRGs) and determine their bias by split- 
ting the entire sample into several subsamples in differ- 
ent luminosity bins and the constrain a smooth function 
6(L), which describes the variation of galaxy bias with 
its luminosity, using modes which are not affected by the 
/nl- One would next construct two effective samples by 
optimally weighting the original sample using Equations 
([25]) and (gU) and replacing b(M) with b(L). In the next 
step, auto and cross-correlation power spectra of these 
two samples should be calculated, taking into account 
the Poisson error correlation between the two. At this 
step, one can use the cross-correlation spectra to check 
for the amount of stochasticity, which has been assumed 
to be negligible in this work. Finally, /nl should be con- 
strained using these power spectra as input. 
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APPENDIX A: INVERSION OF C MATRIX 

We can rewrite Equation ([7]) as 

C = N(I + E), (Al) 

where Nij = 8^VnJ , I is the identity matrix and By = 
riibibjP. The inverse of C can then formally be written 
as an infinite series 

C _1 = (I-E + E 2 -E 3 ...)N _1 . (A2) 

We note that the product 

( E % = ^n i b i b k Pn k b k b j P = 

k 

Eij (£ n k b 2 k P^ = E (b 2 ) (nP) , (A3) 
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and so we can rewrite the inverse of I + E as Since N is diagonal and hence trivial to invert, the Equa- 

tion (|A2[) simplifies to 

(I + E)-'=I- E (l-{l, J )(SP) + ((,') 1 (ftP) 2 ...) „.,,„, 

1 + (fe 2 ) (nP) 1 J 
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